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]. DESIGN OF CONTEXTUAL POSTPROCESSORS 


This section descr ues the requirements for the design of contextual post- 
processors. Section 1.2 contains the requirements for spatially uniform 
context, and section 1.3 contains the requirements for sequential context. 
The following routine, which is common to both contexts, should be developed 
separately. 

1 . 1 COM PUTATION OF POSTERIORI PROBABILITIES 

From the discriminant functions, the posteriori probabilities needed by the 
contextual algorithms are computed as given below. 

• Tnput.,: 

M - number of pattern classes 
e - user-specified constant 
- weight vector for class i 

• Computation: 

9 ,(X) • «{x, i > 1, 2, •••, H 
= mjn g,(X) 



• Outputs: 

p(cjJX), i = 1, 2, M 
1.2 SPATIALLY UNIFORM C ONTEXT 

The local neighborhood for the spatially uniform context is shown in the 
following figure. 
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Figure 1 Four neighbors of picture element (pixel) 0. 


The posteriori probabilities of pixel 0 are updated using information from 
pixels 0, 1 , 2, 3, and 4. 

• Inputs: 

1. Merged data file 

2. Weight vectors file 

3. Number used in dividing the features 

4. Number of classes 

5. Number of features 

6. Locations of featu»"es 

7. Number and locations of training patterns in each class 

8. Number and locations of test patterns in each class 

• Computation: 

a. Updating posteriori probabilities: 


p(o)0 = ^1’ ^2’ ^3’ ^4^ 

I ^ r p(i*>i “ ’nl^i ) 1 ) 

_ P(“o = ® I . 

.r P(“o = <olXo)|jn[" 


1q = 1, 2, M 
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b. Classification: Decide XqCWq « 1q If 

p(u'o • *'*’ ^4^ ‘ *’*’ ^4^ 

1*1 , • • • ,M 

c. Crossvalidation with context: The code Is developed for an error cor- 

rection classifier and should be prepared as a subroutine. The neces- 
sary equations for the Fisher classifier are given In the Fisher 
classifier section and should be prepared as a subroutine. 

d. Computation of 0: 

L(0) * (1 - 0)^ + 0(1 - 0 )^A + 0^(1 - 0)^B + 0^(1 - 0)C + O^D 

M p(a, « IqIXq) 

A = Z * ~ i ~ y ' ' ^ 

Iq'I 0 

+ P(“ = 

M p(u. * IqIXq) 

B = Z ~2 P^^^ * inl^l^P^*^ “ 

1o=l P (u) = Iq) 

+ p(u) = 1 q|X^)p(u) * 101X4) + p(w ' io|X2)p{‘*) = 

+ p(u) - 1 q|X 2 (P(w “ ^0^^4^ ^ P^^ ” ^olX3)P(w “ 

M p(u) = inlXn) 

C = Z -3 [P(‘*> = io|XJp((iJ = 1 o|X 2 )p(w «= iol^3^ 

io=l P = 1 ( 1 ^ 

+ p(u) = 1 q|XPp(u) = io|X 2 )p(w = I 0 IX 4 ) 

+ p(u) = 1 q|Xi)p(‘i) = 1 q|X 2 )p(u) = 'o^^ 4 ^ 

+ p(u) = io|X 2 )p(w = iolX 3 )p(iu = I 0 IX 4 )] 
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4 p(ai ■ 1 q|Xq) 

0 . —4 [p(w ' 1 q|X,)p(u) » iQ|Xp)p(u) iolX^lpCu) • 

P^(u) - ijj) ^ ^ ^ ^ ^ ^ 

Compute the coefficients A, B, C, and D and the roots of the equation 
l-'(O) » 0, where 

L'(0) « aO^ ♦ bO^ + CO + d 

a « 4 - 4A + 4B - 4C + 4D 

b « -12 + 9A - 6B + 3C 

c - 12 - 6A + 2B 

d s -4 + A 

A subroutine the author has written for finding the roots of a 
polynomial should be used. For finding the optimal O, 2 subroutine 
should be developed from the flowchart given in figure 2 (from ref. 1). 



Figure 2.- Procedure for finding in the range 0 1 1 K 

which gives the global maximum of L(0). (From ref. 1.) 
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Classify the end pixels without using the context. 

• Outputs: 

1 . Classification map 

2 . Proportion of classes in the segment from the classification 

3. Confusion matrix on the total dot <;et 

4. Confusion matrix on the test dot set 

5. Confusion matrix of crossvalidation with context 

1 . 3 SEQUENTIAL CONTEXT 

The local neighborhood of the pixel 0, for the use of sequential context, is 
shown in the following figure. ^ ^ ^ 
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Figure 3.- Local neighborhood of pixel 0. 

The posteriori probabilities of each central pixel in a circled group are 
updated using the neighborhood information. The exact equations are given 
below. First, the posteriori probabilities are updated for horizontal groups, 
and then the pixels of the vertical center column are used for updating those 
of pixel 0. 

• Inputs: 

1 . Merged data file 

2. Weight vectors file 

3. Number used in dividing the features 

4. Nuiiiber of classes 
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5. Number of features 

6. Locations of features 

7. Number and locations of training patterns in each class 

8. Number and locations of test patterns in each class 


• Computation: 

a. Updating posteriori probabilities 



b. Classification: Same as in section 1,2 

c. Crossvalidation: Same as in section 1.2 

d. Computation of 0: A separate 0 is computed for each row or column of 

pixels and used in updating the formulas. The computations required 
to be performed in computing the value of 0 for the neighborhood shown 
in figure 3 are given below: 

L(0) = (1 - 0)^ + 0(1 - 0)A + 0^8 
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where 


0 


M p(u) » i_|X„) 

■ E -IT;r:-TT' t>’'“ ■ 'nlVl> * 1*'“ • 'nlVl*’ 

1*1 n 

n 

H, . iJX„) 


'n"' ■ 'n> 

? [V'- J + BJ 


1 ? 

For finding the optimal 0, a subroutine should be developed from the 
flowchart given In figure 2. 

• Outputs: Same as In section 1.2. 

• Applicable document: reference 1 


2. DESIGN OF THE FISHER CLASSIFIER 


This section contains the requirements for the design of the Fisher classifier 
and the use of crossval Idatlon with this classifier. It is assumed that the 
patterns In the classes are arranged as In figure 5. 

• Inputs: 

1. Name of data file 

2. Name of weight vectors file 

3. Number of classes 

4. Number of features 

5. Locations of features 

6. Number of training patterns in each class 
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f Computation: 


a. Means and covariance matrices: 

xj • jth training pattern of class 1 

» number of training patterns of class 1 




1 - 1 , 2 . 


. M 


b. Weight vectors: 

g^(X) ■ discriminant function of class 1 

g^(x) • vjx + v^ 

V, . s;;' S, 

-T*-1 '"'l * "'j ■■■ * "'m' 

''t • -"i^u H 

h ■ h * h * ••• * 



c. Clussificatlon : Same as section 1.2, b. 


d. Formulas for crossval Idatlon : This section gives the expressions which 

are required to be Implemented for crossval idatlon. Expressions are 
given for the case In which a pattern X|| from class is left out. 
this computation Is to be performed In a similar loop when a pattern 
comes on from the other class. 


,1 J 


^1 “ - 2 } • '"l^ 

A 

1 * 1, 2, ••*, M and , 1 = 2, •••, M are computed as In 2a. 


A 



E-| + ^2 ■*■***■*■ 


8 




) 

, ;TM Wl * *2 * ••• * \ 

1 '"rw H ' 


« i*l,2, •••,M 


V(xj|) . s-'(xj -s,) 

6(X|[) ' (X|J - "'i)^S‘'(X|J -nij) 
v(x’) . 1 - ae(xj) 


d] * Y^(xJ)m^ 

j 1 (iti, + m« + • • • + m ) 

. Y^XJ) -J 2 M 


r 


= Y^(xJ)m 


e. = Y^(xJ)m^. , i = 2, •••, M 


1 1 

^ v(X|^) ^ i\../vl\ k 


^ ^-Y(xJ) 


v(X„) 


(N, - i)v(x;;) 

do d 


a 6 (XM 


2(Ni - l)v(X‘) 


TT "1 


d, - 


1 1 
'k> ' ''i * 'TTT''<Xk 


■ l)v(xj[) 

nsT"-'!) 

1 

6(xJ) 

2(N^ -1)^ 

v(xi) 

. i = 2, •- 

■*, M 
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• • • 


M 




v(xj) 2(N, - l)v(*J) 


*) 

»• t 


• Outputs: 

1 . Weight vectors file 

2. Discriminant functions for the total pattern set 

3. Confusion matrix for the total dot set 

4. Confusion matrix for the training dot set 

5. Confusion matrix for the test dot set 

6. Crossvalidation discriminant functions 

7. Crossvalidation confusion matrix 

• Applicable docu.-nent: refercnra 2 




3. CORRECTION OF LABEL IMPERFECTIONS WITH A LINEAR CLASSIFIER 


This section describes the requirements for the identification of Imperfectly 
labeled patterns with the linear classifiers. 

• Inputs: 

1 . Name of dita f1 le 

2. Name of weight vectors file 

3. Number of classes 

4. Number of features 

5. Parameters of Imperfections - 3^2’ ®21 ’ ^22 

6. Confidence level - a 

• Computation: 

W = W^ - W^ 

'^0 ' ‘^Ol ■ ^02 
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. 1 - 1.2 


nil - W ♦ u)q 

2 T'' 

- W E^W 


. 1 - 1.2 


Find and t2* such that 


^ 11®22 ® 12 ® 21 ^ 


022P( 


u) • ])f 


■^■"l 


N(0. l)dc 


r 'h'^'z r 

- 62iP(i - 2)j ^ N(0. l)dc + - 2) j 


-ti^n.2 


N(0, l)dc 


-ti^l 


6^2P(‘*J * 1 ) 


r 


N(0. l)dc 


Store the values of cumulative density of one-dimensional normal variables 
and find t^ and t2 by a one-dimensional search. For each X, Implement the 
label correction scheme, g(X) - W^X + Wq. Change the label of X to w *1 
If g(X) > t^. Change the label of X to 102 11^ g(X) < -t2« Do not change 
the label of X If -t2 ± g(X) £ t^ 

• Outputs: 


1 . Values t^ , t2 

2. Original and corrected labels of the patterns 

• Applicable document: reference 3 
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4. COMPUTATION OF THE PROPORTION OF A CROP OF INTEREST, VARIANCE OF 
PROPORTION OF A CROP OF INTEREST, AND THE VARIANCE REDUCTION FACTOR 


This section defines the requirements for developing a program to compute nn^ 
proportion of a crop of Interest, variance of proportion of a crop of Interest, 
and the variance reduction factor. 

• Inputs: 

1 . Number of classes 

2. Proportions of classes of a whole segment. If available, as classified 
by the classifier 

3. Confusion matrix of the total dot set 

4. Confusion matrix of the test dot set 

• Computation: 

a. Take first class as a crop of Interest and then the proportion of 
class of Interest. 



P(W) * estimated probability of the occurrence of wheat 

P(1) » classifier-estimated probability of occurrence of class 1, 

either obtained from the total dot set or from the whole 
segment 

P(W|1) * given the classifier decision as class 1, probability of 
occurrence of wheat obtained from the confusion matrix of 
the evaluation set (Illustrated below) 

b. Variance of the proportion of the class of Interest 
M 

E P(i)P(W|1)Ll - P(W|1)] 

Var[P(W)] . -’-3 

m * number of samples In the evaluation set 
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c. 


Variance reduction factor 


R 



P(1)P(W|1)[1 - P(W|D] 
P(W)[1 - P(W)] 


d. Percentage of correct classification of the total dot set 

e. Percentage of correct classification of the test dot set 

f. Crossval Idatlon percentage of correct classification. Example: 


Evaluation dot results 


Actual class (1) 

Classified category (j) 

Number belonging 
to each class 

n 

2 

3 

m 

M 

1 

mil 

mi 2 

"’13 

S 

•"iM 

"’l. 

2 

mgi 

"’22 

"’23 

a 

"’ 2 M 


— 

3 

"’31 

’"32 

"’33 

a 

"’3M 

m 3 . 

— 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 


• 

• 

• 

• 

• 

• 

M 

"Vii 



a 

'"MM 

"Vi* 

Number classified 
into category 

■".I 

m ^ 

•Z 

fn ^ 
•3 

■ 

■"•M 

m = m 

• • 


m, . 

P(U|1) > -li 

• 1 

• Applicable document: reference 4 
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5. RANDOM SPLITTING OF DATA INTO TRAINING AND TEST SETS 

This section contains the requiretnents for the random splitting of data into 
training and test sets according to user-specified proportions. 

a Inputs: 

1. Number of classes 

2. Data set file 

3. Number of features 

4. Proportion of each class ior the training set 


Ni«nber of 



Figure 4.- Input data file. 


• Outputs: 
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